Pandas Profiling Report

Dataset statistics

Number of variables	20
Number of observations	338592
Missing cells	3039687
Missing cells (%)	44.9%
Duplicate rows	309470
Duplicate rows (%)	91.4%
Total size in memory	51.7 MiB
Average record size in memory	160.0 B

Variable types

Numeric	20

Warnings

Dataset has 309470 (91.4%) duplicate rows	Duplicates
`PayUmarenPay1` is highly correlated with `PayWidePay1`	High correlation
`PayUmarenNinki1` is highly correlated with `PayWideNinki1`	High correlation
`PayUmarenKumi2` is highly correlated with `PayWideKumi2`	High correlation
`PayUmarenPay2` is highly correlated with `PayWidePay2`	High correlation
`PayUmarenNinki2` is highly correlated with `PayWideNinki2`	High correlation
`PayWidePay1` is highly correlated with `PayUmarenPay1`	High correlation
`PayWideNinki1` is highly correlated with `PayUmarenNinki1`	High correlation
`PayWideKumi2` is highly correlated with `PayUmarenKumi2`	High correlation
`PayWidePay2` is highly correlated with `PayUmarenPay2`	High correlation
`PayWideNinki2` is highly correlated with `PayUmarenNinki2`	High correlation
`PayUmarenKumi2` has 337893 (99.8%) missing values	Missing
`PayUmarenPay2` has 337893 (99.8%) missing values	Missing
`PayUmarenNinki2` has 337893 (99.8%) missing values	Missing
`PayWideKumi4` has 337668 (99.7%) missing values	Missing
`PayWidePay4` has 337668 (99.7%) missing values	Missing
`PayWideNinki4` has 337668 (99.7%) missing values	Missing
`PayWideKumi5` has 337668 (99.7%) missing values	Missing
`PayWidePay5` has 337668 (99.7%) missing values	Missing
`PayWideNinki5` has 337668 (99.7%) missing values	Missing

Reproduction

Analysis started	2021-04-07 12:57:51.491931
Analysis finished	2021-04-07 12:59:34.353794
Duration	1 minute and 42.86 seconds
Software version	pandas-profiling v2.11.0
Download configuration	config.yaml

PayUmarenPay1
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	3244
Distinct (%)	1.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	6210.123246
Minimum	120
Maximum	446550
Zeros	0
Zeros (%)	0.0%
Memory size	2.6 MiB

Quantile statistics

Minimum	120
5-th percentile	390
Q1	920
median	2010
Q3	5180
95-th percentile	24370
Maximum	446550
Range	446430
Interquartile range (IQR)	4260

Descriptive statistics

Standard deviation	15620.03699
Coefficient of variation (CV)	2.515253944
Kurtosis	141.3314332
Mean	6210.123246
Median Absolute Deviation (MAD)	1360
Skewness	9.325312704
Sum	2102698050
Variance	243985555.5
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
700	1662	0.5%
560	1576	0.5%
720	1512	0.4%
550	1475	0.4%
570	1459	0.4%
510	1439	0.4%
770	1432	0.4%
610	1421	0.4%
660	1405	0.4%
480	1386	0.4%
Other values (3234)	323825	95.6%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
120	15	< 0.1%
130	29	< 0.1%
140	87	< 0.1%
150	112	< 0.1%
160	131	< 0.1%

Value	Count	Frequency (%)
446550	10	< 0.1%
442370	12	< 0.1%
365760	12	< 0.1%
362250	6	< 0.1%
320310	15	< 0.1%

PayUmarenNinki1
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	127
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	13.84270745
Minimum	1
Maximum	146
Zeros	0
Zeros (%)	0.0%
Memory size	2.6 MiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	3
median	7
Q3	18
95-th percentile	51
Maximum	146
Range	145
Interquartile range (IQR)	15

Descriptive statistics

Standard deviation	17.27642682
Coefficient of variation (CV)	1.248052586
Kurtosis	6.690521534
Mean	13.84270745
Median Absolute Deviation (MAD)	5
Skewness	2.339511894
Sum	4687030
Variance	298.4749238
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	50054	14.8%
2	32460	9.6%
3	25672	7.6%
4	20421	6.0%
5	17639	5.2%
6	15826	4.7%
7	13275	3.9%
8	11180	3.3%
9	9809	2.9%
10	9028	2.7%
Other values (117)	133228	39.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	50054	14.8%
2	32460	9.6%
3	25672	7.6%
4	20421	6.0%
5	17639	5.2%

Value	Count	Frequency (%)
146	17	< 0.1%
139	18	< 0.1%
137	17	< 0.1%
136	10	< 0.1%
131	16	< 0.1%

PayUmarenKumi2
Real number (ℝ_≥0)

HIGH CORRELATION
MISSING

Distinct	41
Distinct (%)	5.9%
Missing	337893
Missing (%)	99.8%
Infinite	0
Infinite (%)	0.0%

Mean	686.8998569
Minimum	104
Maximum	1415
Zeros	0
Zeros (%)	0.0%
Memory size	2.6 MiB

Quantile statistics

Minimum	104
5-th percentile	206
Q1	415
median	710
Q3	911
95-th percentile	1316
Maximum	1415
Range	1311
Interquartile range (IQR)	496

Descriptive statistics

Standard deviation	319.8225264
Coefficient of variation (CV)	0.4656028433
Kurtosis	-0.3410953229
Mean	686.8998569
Median Absolute Deviation (MAD)	202
Skewness	0.2946987027
Sum	480143
Variance	102286.4484
Monotocity	Not monotonic

Histogram with fixed size bins (bins=41)

Value	Count	Frequency (%)
811	63	< 0.1%
710	40	< 0.1%
608	29	< 0.1%
913	26	< 0.1%
411	26	< 0.1%
1315	26	< 0.1%
809	26	< 0.1%
314	25	< 0.1%
510	24	< 0.1%
611	23	< 0.1%
Other values (31)	391	0.1%
(Missing)	337893	99.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
104	8	< 0.1%
113	14	< 0.1%
203	6	< 0.1%
206	8	< 0.1%
208	12	< 0.1%

Value	Count	Frequency (%)
1415	11	< 0.1%
1317	16	< 0.1%
1316	13	< 0.1%
1315	26	< 0.1%
1114	15	< 0.1%

PayUmarenPay2
Real number (ℝ_≥0)

HIGH CORRELATION
MISSING

Distinct	51
Distinct (%)	7.3%
Missing	337893
Missing (%)	99.8%
Infinite	0
Infinite (%)	0.0%

Mean	2938.240343
Minimum	160
Maximum	28210
Zeros	0
Zeros (%)	0.0%
Memory size	2.6 MiB

Quantile statistics

Minimum	160
5-th percentile	240
Q1	480
median	1150
Q3	3730
95-th percentile	10800
Maximum	28210
Range	28050
Interquartile range (IQR)	3250

Descriptive statistics

Standard deviation	4748.838274
Coefficient of variation (CV)	1.616218457
Kurtosis	14.24674611
Mean	2938.240343
Median Absolute Deviation (MAD)	800
Skewness	3.464512378
Sum	2053830
Variance	22551464.95
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
400	28	< 0.1%
1700	27	< 0.1%
240	26	< 0.1%
350	26	< 0.1%
800	26	< 0.1%
480	20	< 0.1%
1030	17	< 0.1%
10800	16	< 0.1%
670	16	< 0.1%
320	15	< 0.1%
Other values (41)	482	0.1%
(Missing)	337893	99.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
160	8	< 0.1%
180	6	< 0.1%
200	14	< 0.1%
240	26	< 0.1%
320	15	< 0.1%

Value	Count	Frequency (%)
28210	14	< 0.1%
14070	15	< 0.1%
10800	16	< 0.1%
9880	15	< 0.1%
9360	10	< 0.1%

PayUmarenNinki2
Real number (ℝ_≥0)

HIGH CORRELATION
MISSING

Distinct	26
Distinct (%)	3.7%
Missing	337893
Missing (%)	99.8%
Infinite	0
Infinite (%)	0.0%

Mean	15.38054363
Minimum	1
Maximum	82
Zeros	0
Zeros (%)	0.0%
Memory size	2.6 MiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	2.5
median	7
Q3	22
95-th percentile	54
Maximum	82
Range	81
Interquartile range (IQR)	19.5

Descriptive statistics

Standard deviation	18.84056068
Coefficient of variation (CV)	1.224960647
Kurtosis	3.491231674
Mean	15.38054363
Median Absolute Deviation (MAD)	6
Skewness	1.926330545
Sum	10751
Variance	354.9667269
Monotocity	Not monotonic

Histogram with fixed size bins (bins=26)

Value	Count	Frequency (%)
1	122	< 0.1%
3	67	< 0.1%
2	53	< 0.1%
6	37	< 0.1%
28	37	< 0.1%
5	31	< 0.1%
7	27	< 0.1%
9	26	< 0.1%
4	26	< 0.1%
16	24	< 0.1%
Other values (16)	249	0.1%
(Missing)	337893	99.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	122	< 0.1%
2	53	< 0.1%
3	67	< 0.1%
4	26	< 0.1%
5	31	< 0.1%

Value	Count	Frequency (%)
82	16	< 0.1%
74	15	< 0.1%
54	10	< 0.1%
50	15	< 0.1%
49	14	< 0.1%

PayWideKumi1
Real number (ℝ_≥0)

Distinct	153
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	549.9749994
Minimum	102
Maximum	1718
Zeros	0
Zeros (%)	0.0%
Memory size	2.6 MiB

Quantile statistics

Minimum	102
5-th percentile	106
Q1	214
median	507
Q3	811
95-th percentile	1215
Maximum	1718
Range	1616
Interquartile range (IQR)	597

Descriptive statistics

Standard deviation	358.6424735
Coefficient of variation (CV)	0.6521068666
Kurtosis	-0.3568882159
Mean	549.9749994
Median Absolute Deviation (MAD)	296
Skewness	0.6847124509
Sum	186217135
Variance	128624.4238
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
203	4381	1.3%
204	4275	1.3%
405	4220	1.2%
102	4151	1.2%
406	4082	1.2%
206	4064	1.2%
304	4045	1.2%
105	4032	1.2%
104	3990	1.2%
407	3943	1.2%
Other values (143)	297409	87.8%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
102	4151	1.2%
103	3864	1.1%
104	3990	1.2%
105	4032	1.2%
106	3424	1.0%

Value	Count	Frequency (%)
1718	325	0.1%
1618	246	0.1%
1617	223	0.1%
1518	368	0.1%
1517	207	0.1%

PayWidePay1
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	1410
Distinct (%)	0.4%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	1651.143264
Minimum	110
Maximum	124860
Zeros	0
Zeros (%)	0.0%
Memory size	2.6 MiB

Quantile statistics

Minimum	110
5-th percentile	190
Q1	380
median	720
Q3	1590
95-th percentile	5900
Maximum	124860
Range	124750
Interquartile range (IQR)	1210

Descriptive statistics

Standard deviation	3313.864679
Coefficient of variation (CV)	2.007012203
Kurtosis	143.5580337
Mean	1651.143264
Median Absolute Deviation (MAD)	430
Skewness	8.727772953
Sum	559063900
Variance	10981699.11
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
280	4061	1.2%
300	3936	1.2%
290	3882	1.1%
270	3828	1.1%
320	3793	1.1%
350	3764	1.1%
330	3686	1.1%
260	3630	1.1%
370	3575	1.1%
250	3510	1.0%
Other values (1400)	300927	88.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
110	486	0.1%
120	567	0.2%
130	1081	0.3%
140	1931	0.6%
150	2064	0.6%

Value	Count	Frequency (%)
124860	10	< 0.1%
75200	12	< 0.1%
71630	17	< 0.1%
70440	12	< 0.1%
69240	13	< 0.1%

PayWideNinki1
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	128
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	13.94676484
Minimum	1
Maximum	145
Zeros	0
Zeros (%)	0.0%
Memory size	2.6 MiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	3
median	7
Q3	18
95-th percentile	51
Maximum	145
Range	144
Interquartile range (IQR)	15

Descriptive statistics

Standard deviation	17.35086984
Coefficient of variation (CV)	1.244078469
Kurtosis	6.573190506
Mean	13.94676484
Median Absolute Deviation (MAD)	5
Skewness	2.323066423
Sum	4722263
Variance	301.0526843
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	48821	14.4%
2	32755	9.7%
3	25344	7.5%
4	20867	6.2%
5	17482	5.2%
6	15678	4.6%
7	12726	3.8%
8	12039	3.6%
9	10274	3.0%
10	8827	2.6%
Other values (118)	133779	39.5%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	48821	14.4%
2	32755	9.7%
3	25344	7.5%
4	20867	6.2%
5	17482	5.2%

Value	Count	Frequency (%)
145	17	< 0.1%
144	10	< 0.1%
133	43	< 0.1%
131	30	< 0.1%
130	17	< 0.1%

PayWideKumi2
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	153
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	538.3800326
Minimum	102
Maximum	1718
Zeros	0
Zeros (%)	0.0%
Memory size	2.6 MiB

Quantile statistics

Minimum	102
5-th percentile	106
Q1	213
median	506
Q3	809
95-th percentile	1215
Maximum	1718
Range	1616
Interquartile range (IQR)	596

Descriptive statistics

Standard deviation	354.9315621
Coefficient of variation (CV)	0.6592584059
Kurtosis	-0.2486483404
Mean	538.3800326
Median Absolute Deviation (MAD)	294
Skewness	0.7344644814
Sum	182291172
Variance	125976.4137
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
203	4342	1.3%
104	4287	1.3%
102	4281	1.3%
103	4227	1.2%
406	4081	1.2%
304	4062	1.2%
207	3961	1.2%
607	3939	1.2%
405	3917	1.2%
107	3915	1.2%
Other values (143)	297580	87.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
102	4281	1.3%
103	4227	1.2%
104	4287	1.3%
105	3766	1.1%
106	3889	1.1%

Value	Count	Frequency (%)
1718	227	0.1%
1618	257	0.1%
1617	353	0.1%
1518	243	0.1%
1517	302	0.1%

PayWidePay2
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	1584
Distinct (%)	0.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	2023.586145
Minimum	110
Maximum	129000
Zeros	0
Zeros (%)	0.0%
Memory size	2.6 MiB

Quantile statistics

Minimum	110
5-th percentile	220
Q1	460
median	890
Q3	1960
95-th percentile	7290
Maximum	129000
Range	128890
Interquartile range (IQR)	1500

Descriptive statistics

Standard deviation	3919.778376
Coefficient of variation (CV)	1.93704547
Kurtosis	119.0028255
Mean	2023.586145
Median Absolute Deviation (MAD)	540
Skewness	7.998962791
Sum	685170080
Variance	15364662.52
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
320	3271	1.0%
410	3228	1.0%
390	3196	0.9%
400	3172	0.9%
280	3154	0.9%
270	3141	0.9%
360	3114	0.9%
380	3096	0.9%
370	3067	0.9%
290	2997	0.9%
Other values (1574)	307156	90.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
110	148	< 0.1%
120	385	0.1%
130	543	0.2%
140	890	0.3%
150	1187	0.4%

Value	Count	Frequency (%)
129000	12	< 0.1%
96560	11	< 0.1%
85380	12	< 0.1%
84810	11	< 0.1%
81520	14	< 0.1%

PayWideNinki2
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	131
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	16.6721157
Minimum	1
Maximum	148
Zeros	0
Zeros (%)	0.0%
Memory size	2.6 MiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	4
median	10
Q3	22
95-th percentile	57
Maximum	148
Range	147
Interquartile range (IQR)	18

Descriptive statistics

Standard deviation	18.87688989
Coefficient of variation (CV)	1.132243215
Kurtosis	5.167001671
Mean	16.6721157
Median Absolute Deviation (MAD)	7
Skewness	2.089936533
Sum	5645045
Variance	356.3369718
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	30802	9.1%
2	25245	7.5%
3	23113	6.8%
4	19631	5.8%
5	16773	5.0%
6	14683	4.3%
7	13235	3.9%
8	11927	3.5%
9	11178	3.3%
10	9694	2.9%
Other values (121)	162311	47.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	30802	9.1%
2	25245	7.5%
3	23113	6.8%
4	19631	5.8%
5	16773	5.0%

Value	Count	Frequency (%)
148	16	< 0.1%
140	17	< 0.1%
137	31	< 0.1%
136	18	< 0.1%
134	16	< 0.1%

PayWideKumi3
Real number (ℝ_≥0)

Distinct	153
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	539.3373057
Minimum	102
Maximum	1718
Zeros	0
Zeros (%)	0.0%
Memory size	2.6 MiB

Quantile statistics

Minimum	102
5-th percentile	106
Q1	213
median	506
Q3	809
95-th percentile	1215
Maximum	1718
Range	1616
Interquartile range (IQR)	596

Descriptive statistics

Standard deviation	353.4615192
Coefficient of variation (CV)	0.6553626376
Kurtosis	-0.246561507
Mean	539.3373057
Median Absolute Deviation (MAD)	293
Skewness	0.731560387
Sum	182615297
Variance	124935.0456
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
103	4299	1.3%
608	4242	1.3%
204	4193	1.2%
206	4108	1.2%
305	4087	1.2%
104	4009	1.2%
506	3962	1.2%
304	3957	1.2%
203	3952	1.2%
708	3928	1.2%
Other values (143)	297855	88.0%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
102	3515	1.0%
103	4299	1.3%
104	4009	1.2%
105	3854	1.1%
106	3803	1.1%

Value	Count	Frequency (%)
1718	299	0.1%
1618	356	0.1%
1617	251	0.1%
1518	303	0.1%
1517	248	0.1%

PayWidePay3
Real number (ℝ_≥0)

Distinct	1878
Distinct (%)	0.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	2616.699804
Minimum	110
Maximum	117910
Zeros	0
Zeros (%)	0.0%
Memory size	2.6 MiB

Quantile statistics

Minimum	110
5-th percentile	250
Q1	550
median	1110
Q3	2560
95-th percentile	9800
Maximum	117910
Range	117800
Interquartile range (IQR)	2010

Descriptive statistics

Standard deviation	5079.497338
Coefficient of variation (CV)	1.941184591
Kurtosis	97.31017237
Mean	2616.699804
Median Absolute Deviation (MAD)	700
Skewness	7.547367882
Sum	885993620
Variance	25801293.21
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
370	2654	0.8%
410	2645	0.8%
400	2641	0.8%
380	2628	0.8%
390	2610	0.8%
350	2598	0.8%
340	2577	0.8%
420	2569	0.8%
430	2437	0.7%
310	2378	0.7%
Other values (1868)	312855	92.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
110	56	< 0.1%
120	87	< 0.1%
130	267	0.1%
140	552	0.2%
150	581	0.2%

Value	Count	Frequency (%)
117910	16	< 0.1%
109100	16	< 0.1%
106360	10	< 0.1%
105990	15	< 0.1%
105110	14	< 0.1%

PayWideNinki3
Real number (ℝ_≥0)

Distinct	139
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	20.26387511
Minimum	1
Maximum	147
Zeros	0
Zeros (%)	0.0%
Memory size	2.6 MiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	5
median	13
Q3	28
95-th percentile	65
Maximum	147
Range	146
Interquartile range (IQR)	23

Descriptive statistics

Standard deviation	21.03656246
Coefficient of variation (CV)	1.038131273
Kurtosis	3.774789036
Mean	20.26387511
Median Absolute Deviation (MAD)	9
Skewness	1.823504803
Sum	6861186
Variance	442.53696
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	20348	6.0%
2	18474	5.5%
3	17725	5.2%
4	16211	4.8%
5	15604	4.6%
6	13507	4.0%
7	13165	3.9%
8	11456	3.4%
9	11194	3.3%
10	9945	2.9%
Other values (129)	190963	56.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	20348	6.0%
2	18474	5.5%
3	17725	5.2%
4	16211	4.8%
5	15604	4.6%

Value	Count	Frequency (%)
147	10	< 0.1%
146	17	< 0.1%
145	9	< 0.1%
143	14	< 0.1%
142	31	< 0.1%

PayWideKumi4
Real number (ℝ_≥0)

MISSING

Distinct	56
Distinct (%)	6.1%
Missing	337668
Missing (%)	99.7%
Infinite	0
Infinite (%)	0.0%

Mean	444.2835498
Minimum	102
Maximum	1314
Zeros	0
Zeros (%)	0.0%
Memory size	2.6 MiB

Quantile statistics

Minimum	102
5-th percentile	104
Q1	203
median	312
Q3	710
95-th percentile	1012
Maximum	1314
Range	1212
Interquartile range (IQR)	507

Descriptive statistics

Standard deviation	324.1941116
Coefficient of variation (CV)	0.7297009123
Kurtosis	-0.4754475071
Mean	444.2835498
Median Absolute Deviation (MAD)	200
Skewness	0.7684466034
Sum	410518
Variance	105101.822
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
206	33	< 0.1%
510	32	< 0.1%
405	32	< 0.1%
205	30	< 0.1%
103	29	< 0.1%
711	26	< 0.1%
911	24	< 0.1%
203	24	< 0.1%
709	24	< 0.1%
809	24	< 0.1%
Other values (46)	646	0.2%
(Missing)	337668	99.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
102	6	< 0.1%
103	29	< 0.1%
104	17	< 0.1%
105	15	< 0.1%
106	8	< 0.1%

Value	Count	Frequency (%)
1314	16	< 0.1%
1213	15	< 0.1%
1015	13	< 0.1%
1012	13	< 0.1%
915	11	< 0.1%

PayWidePay4
Real number (ℝ_≥0)

MISSING

Distinct	62
Distinct (%)	6.7%
Missing	337668
Missing (%)	99.7%
Infinite	0
Infinite (%)	0.0%

Mean	1434.458874
Minimum	130
Maximum	15710
Zeros	0
Zeros (%)	0.0%
Memory size	2.6 MiB

Quantile statistics

Minimum	130
5-th percentile	240
Q1	480
median	770
Q3	1450
95-th percentile	5080
Maximum	15710
Range	15580
Interquartile range (IQR)	970

Descriptive statistics

Standard deviation	2252.913469
Coefficient of variation (CV)	1.57056679
Kurtosis	25.74087869
Mean	1434.458874
Median Absolute Deviation (MAD)	350
Skewness	4.702483819
Sum	1325440
Variance	5075619.1
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1090	39	< 0.1%
710	32	< 0.1%
510	28	< 0.1%
240	28	< 0.1%
480	27	< 0.1%
260	27	< 0.1%
450	26	< 0.1%
490	26	< 0.1%
530	25	< 0.1%
570	21	< 0.1%
Other values (52)	645	0.2%
(Missing)	337668	99.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
130	6	< 0.1%
170	5	< 0.1%
190	18	< 0.1%
240	28	< 0.1%
250	11	< 0.1%

Value	Count	Frequency (%)
15710	16	< 0.1%
6070	12	< 0.1%
5890	13	< 0.1%
5080	17	< 0.1%
3830	9	< 0.1%

PayWideNinki4
Real number (ℝ_≥0)

MISSING

Distinct	36
Distinct (%)	3.9%
Missing	337668
Missing (%)	99.7%
Infinite	0
Infinite (%)	0.0%

Mean	19.93506494
Minimum	1
Maximum	87
Zeros	0
Zeros (%)	0.0%
Memory size	2.6 MiB

Quantile statistics

Minimum	1
5-th percentile	2.15
Q1	8
median	14
Q3	26
95-th percentile	57
Maximum	87
Range	86
Interquartile range (IQR)	18

Descriptive statistics

Standard deviation	17.51644032
Coefficient of variation (CV)	0.8786748563
Kurtosis	2.683227212
Mean	19.93506494
Median Absolute Deviation (MAD)	7
Skewness	1.64183593
Sum	18420
Variance	306.8256814
Monotocity	Not monotonic

Histogram with fixed size bins (bins=36)

Value	Count	Frequency (%)
14	77	< 0.1%
7	58	< 0.1%
9	58	< 0.1%
17	58	< 0.1%
8	55	< 0.1%
10	53	< 0.1%
3	43	< 0.1%
18	36	< 0.1%
6	34	< 0.1%
49	29	< 0.1%
Other values (26)	423	0.1%
(Missing)	337668	99.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	28	< 0.1%
2	19	< 0.1%
3	43	< 0.1%
4	11	< 0.1%
5	8	< 0.1%

Value	Count	Frequency (%)
87	16	< 0.1%
62	13	< 0.1%
61	12	< 0.1%
57	17	< 0.1%
50	15	< 0.1%

PayWideKumi5
Real number (ℝ_≥0)

MISSING

Distinct	61
Distinct (%)	6.6%
Missing	337668
Missing (%)	99.7%
Infinite	0
Infinite (%)	0.0%

Mean	687.025974
Minimum	105
Maximum	1516
Zeros	0
Zeros (%)	0.0%
Memory size	2.6 MiB

Quantile statistics

Minimum	105
5-th percentile	116
Q1	309
median	709
Q3	1013
95-th percentile	1416
Maximum	1516
Range	1411
Interquartile range (IQR)	704

Descriptive statistics

Standard deviation	403.9949977
Coefficient of variation (CV)	0.5880345328
Kurtosis	-0.9347520319
Mean	687.025974
Median Absolute Deviation (MAD)	304
Skewness	0.3636459561
Sum	634812
Variance	163211.9582
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1416	31	< 0.1%
1415	31	< 0.1%
514	29	< 0.1%
1013	29	< 0.1%
214	28	< 0.1%
711	27	< 0.1%
309	26	< 0.1%
915	25	< 0.1%
408	23	< 0.1%
307	22	< 0.1%
Other values (51)	653	0.2%
(Missing)	337668	99.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
105	6	< 0.1%
107	15	< 0.1%
109	10	< 0.1%
112	9	< 0.1%
116	16	< 0.1%

Value	Count	Frequency (%)
1516	11	< 0.1%
1418	17	< 0.1%
1416	31	< 0.1%
1415	31	< 0.1%
1315	15	< 0.1%

PayWidePay5
Real number (ℝ_≥0)

MISSING

Distinct	69
Distinct (%)	7.5%
Missing	337668
Missing (%)	99.7%
Infinite	0
Infinite (%)	0.0%

Mean	1874.87013
Minimum	150
Maximum	10360
Zeros	0
Zeros (%)	0.0%
Memory size	2.6 MiB

Quantile statistics

Minimum	150
5-th percentile	220
Q1	530
median	1050
Q3	2010
95-th percentile	7500
Maximum	10360
Range	10210
Interquartile range (IQR)	1480

Descriptive statistics

Standard deviation	2296.960421
Coefficient of variation (CV)	1.225130416
Kurtosis	4.888568443
Mean	1874.87013
Median Absolute Deviation (MAD)	650
Skewness	2.289966801
Sum	1732380
Variance	5276027.177
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
290	29	< 0.1%
380	29	< 0.1%
220	23	< 0.1%
1050	21	< 0.1%
2390	19	< 0.1%
730	19	< 0.1%
6490	18	< 0.1%
1470	18	< 0.1%
530	18	< 0.1%
2310	17	< 0.1%
Other values (59)	713	0.2%
(Missing)	337668	99.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
150	4	< 0.1%
160	5	< 0.1%
170	7	< 0.1%
180	16	< 0.1%
200	13	< 0.1%

Value	Count	Frequency (%)
10360	15	< 0.1%
10270	16	< 0.1%
8090	11	< 0.1%
7500	15	< 0.1%
6490	18	< 0.1%

PayWideNinki5
Real number (ℝ_≥0)

MISSING

Distinct	43
Distinct (%)	4.7%
Missing	337668
Missing (%)	99.7%
Infinite	0
Infinite (%)	0.0%

Mean	26.48917749
Minimum	1
Maximum	90
Zeros	0
Zeros (%)	0.0%
Memory size	2.6 MiB

Quantile statistics

Minimum	1
5-th percentile	2
Q1	8
median	22
Q3	37
95-th percentile	71
Maximum	90
Range	89
Interquartile range (IQR)	29

Descriptive statistics

Standard deviation	22.00686615
Coefficient of variation (CV)	0.8307870701
Kurtosis	0.136074914
Mean	26.48917749
Median Absolute Deviation (MAD)	14
Skewness	0.9901631021
Sum	24476
Variance	484.3021579
Monotocity	Not monotonic

Histogram with fixed size bins (bins=43)

Value	Count	Frequency (%)
15	82	< 0.1%
4	49	< 0.1%
22	49	< 0.1%
7	49	< 0.1%
13	42	< 0.1%
1	42	< 0.1%
14	38	< 0.1%
2	30	< 0.1%
5	30	< 0.1%
24	27	< 0.1%
Other values (33)	486	0.1%
(Missing)	337668	99.7%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1	42	< 0.1%
2	30	< 0.1%
3	25	< 0.1%
4	49	< 0.1%
5	30	< 0.1%

Value	Count	Frequency (%)
90	15	< 0.1%
76	15	< 0.1%
72	16	< 0.1%
71	16	< 0.1%
68	23	< 0.1%

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

The correlation heatmap measures nullity correlation: how strongly the presence or absence of one variable affects the presence of another.

The dendrogram allows you to more fully correlate variable completion, revealing trends deeper than the pairwise ones visible in the correlation heatmap.

First rows

	PayUmarenPay1	PayUmarenNinki1	PayUmarenKumi2	PayUmarenPay2	PayUmarenNinki2	PayWideKumi1	PayWidePay1	PayWideNinki1	PayWideKumi2	PayWidePay2	PayWideNinki2	PayWideKumi3	PayWidePay3	PayWideNinki3	PayWideKumi4	PayWidePay4	PayWideNinki4	PayWideKumi5	PayWidePay5	PayWideNinki5
0	1490	4	nan	nan	nan	1516	600	4	516	850	10	515	420	2	nan	nan	nan	nan	nan	nan
1	800	2	nan	nan	nan	809	320	2	108	240	1	109	470	6	nan	nan	nan	nan	nan	nan
2	420	1	nan	nan	nan	408	210	1	405	230	2	508	660	10	nan	nan	nan	nan	nan	nan
3	30420	78	nan	nan	nan	1516	8310	88	615	1150	7	616	17790	131	nan	nan	nan	nan	nan	nan
4	1490	4	nan	nan	nan	1516	600	4	516	850	10	515	420	2	nan	nan	nan	nan	nan	nan
5	7100	28	nan	nan	nan	912	1540	17	916	260	1	1216	1530	16	nan	nan	nan	nan	nan	nan
6	8380	27	nan	nan	nan	108	1970	24	112	3330	35	812	4960	41	nan	nan	nan	nan	nan	nan
7	400	1	nan	nan	nan	616	220	1	716	3110	28	607	5510	55	nan	nan	nan	nan	nan	nan
8	36280	66	nan	nan	nan	1416	7260	62	1214	15440	85	1216	29450	107	nan	nan	nan	nan	nan	nan
9	650	1	nan	nan	nan	814	330	1	1114	390	4	811	1090	11	nan	nan	nan	nan	nan	nan

Last rows

	PayUmarenPay1	PayUmarenNinki1	PayUmarenKumi2	PayUmarenPay2	PayUmarenNinki2	PayWideKumi1	PayWidePay1	PayWideNinki1	PayWideKumi2	PayWidePay2	PayWideNinki2	PayWideKumi3	PayWidePay3	PayWideNinki3	PayWideKumi4	PayWidePay4	PayWideNinki4	PayWideKumi5	PayWidePay5	PayWideNinki5
338582	240	1	nan	nan	nan	205	140	1	208	620	7	508	1100	10	nan	nan	nan	nan	nan	nan
338583	240	1	nan	nan	nan	205	140	1	208	620	7	508	1100	10	nan	nan	nan	nan	nan	nan
338584	6570	22	nan	nan	nan	213	2090	25	102	1040	9	113	1140	12	nan	nan	nan	nan	nan	nan
338585	17730	43	nan	nan	nan	815	5670	48	608	1830	19	615	3540	36	nan	nan	nan	nan	nan	nan
338586	870	1	nan	nan	nan	204	490	2	412	1040	14	212	740	9	nan	nan	nan	nan	nan	nan
338587	900	4	nan	nan	nan	810	410	5	110	2730	25	108	3160	27	nan	nan	nan	nan	nan	nan
338588	1640	7	nan	nan	nan	610	480	4	210	380	2	206	430	3	nan	nan	nan	nan	nan	nan
338589	630	1	nan	nan	nan	714	270	1	607	490	6	614	580	8	nan	nan	nan	nan	nan	nan
338590	6250	20	nan	nan	nan	509	1700	17	405	3340	34	409	7910	60	nan	nan	nan	nan	nan	nan
338591	1160	3	nan	nan	nan	910	570	5	1014	7050	56	914	10720	69	nan	nan	nan	nan	nan	nan

Overview

Variables

Interactions

Correlations

Pearson's r

Spearman's ρ

Kendall's τ

Phik (φk)

Missing values

Sample

First rows

Last rows